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I ssues concerning the identification 
and training of leaders have roots in 
the earliest forms of modern Western 
education. Hatos Republic outlines a 
plan allowing only those persons pos- 
sessing the highest intellectual ability 
to receive training as a philosopher 
king, those who comprised the ruling 
body (Bloom, 1991). Thomas 
Jefferson also addressed the need for 
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selecting and educating leaders for 
the United States of America, a bur- 
geoning democracy at the time. 
Jefferson’s 1779 Bill for the More 
General Diffusion of Knowledge 
argued that a responsibility of educa- 
tion in a democratic society lay in 
identifying people of talent and 
preparing them to assume leadership 
roles (Gutek, 1995). 


plem-Solving Grou^ 

by Jennifer Jolly and Todd Kettler 


Assessment 
of Leadership 

Twentieth-century educators con- 
tinued to grapple with similar questions. 
Leta Hollingworth, one of gifted educa- 
tion’s earliest pioneers, recognized the 
role and responsibilities that future lead- 
ers would encounter. In 1939, quantita- 
tive knowledge did not exist regarding 
the fundamental traits of leadership. 
Researchers largely agreed that leader- 
ship closely aligned with intelligence. 
For example, Hollingworth (1939) 
observed, “No one has ever advocated 
stupidity as a qualification for a leader” 
(p. 575). During this time period, intel- 
ligence became the “only fundamental 
qualification” (Hollingworth, p. 579). 
Hollingworth elaborated, “It will be a 
long time before we advance to a point 
where we can measure these [leadership 
traits] as well as we can measure intelli- 
gence” (p. 579). More than a half-cen- 
tury later, research in this field remains 
sparse despite the real need for empirical 


studies, including both quantitative and 
qualitative measures (Edmunds, 1998). 

The 1972 publication of the 
Marland Report by the U.S. 
Commissioner of Education proposed a 
multifaceted definition of gifted and tal- 
ented education, enhancing what tradi- 
tionally had been a focus on academics. 
Leadership materialized as a component 
of giftedness, along with general intellec- 
tual ability, specific academic aptitude, 
creative or productive thinking, visual 
and performing arts, and psychomotor 
ability (Foster, 1981; Karnes, Riley, & 
McGinnis, 1996). States, including but 
not limited to Indiana, Oklahoma, 
Texas, Idaho, and Colorado, all define 
giftedness in their state education codes 
as including a high or unusual capacity 
for leadership (Stephens & Karnes, 
2000). Definitions of giftedness and sub- 
sequently leadership at both the federal 
and state levels of government present an 
ongoing struggle between one based on 
governmental policy and one that can be 
conceptually and empirically defined 
(Foster). The inclusion of leadership in 


state education definitions of giftedness 
necessitates measures to identify those 
with leadership qualities; however, few 
exist. The measurements that are avail- 
able possess marginal psychometric pro p- 
e rties or are not normed for this specific 
population (Oakland, Falkenberg, & 
Oakland, 1996). 

Curricula to Develop 
Leadership 

In the 30 years since the Marland 
Report, financial resouroes for leader- 
ship programs and curricula have been 
made available, but how to proceed 
with the implementation of such pro- 
grams remains ambiguous (Foster, 
1981). Bean and Karnes (2001) sug- 
gested that, even though leadership is a 
part of many state definitions on gift- 
edness, little attention is given to cur- 
ricular adjustments or the definition of 
leadership itself Attempts through cur- 
ricular strategies to develop leadership 
in all academic areas by studying the 
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biographies and autobiographies of 
outstanding leaders builds upon work 
originally pioneered by HsIIingworth 
(Klein, 2002). Within the curriculum 
of The Evolution of Common Things, 
ftllingworth’s classes at the Speyer 
School examined the biographies of 
people considered great and who signif- 
icantly impacted their culture (Farrall 
& Kronborg, 1996; Hollingworth, 
1939). Other curricular alternatives 
include units on leadership and build- 
ing leadership through extracurricular 
activities. However, only a handful of 
gifted programs actually identify stu- 
dents with leadership potential or have 
leadership instruction integrated into 
the curriculum. 

Definitions 

of Emergent Leadership 

Leadership has been characterized 
by particular personal qualities and 
traits, specifically one’s ability to influ- 
ence others’ thoughts, energies, emo- 
tions, feelings, or behaviors within the 
scope of emergent leadership (Farrall 
& Kronberg, 1996). Based on self- 
organization patterns of groups, a 
leader emerges while other group 
members move into roles that are best 
suited for their skills and personalities 
(Cattell & Stice, 1954; Roach, 
Wyman, Brookes, Chavez, Heath, & 
Valdes, 1999; Zaror & Guastello, 
2000). Leaderless group settings are 
also commonly used to identify work- 
ers for promotions in large corpora- 
tions (Guastello, 2002). 

According to this theory, a leader 
emerges in a situation in which one was 
not formally appointed. The type of 
leader that develops in an emergent situ- 
ation typically is a transformational 
leader. This form of leadership is differ- 
entiated from facilitative leadership by 
the following four indices: (a) idealized 
influence — the leader becomes a role 


model for others in the group; (b) inspi- 
rational motivation — the leader may 
inspire or motivate the group members 
to forge ahead when the generation of 
ideas has stalled; (c) intellectual stimula- 
tion — the leader is supportive of others 
thoughts and ideas; and (d) individual- 
ized consideration — the emerging leader 
begins to see the match between tasks 
and group member traits, thus delegat- 
ing work accordingly (Guastello, 2002). 

In the last review of leadership 
assessments for youth by Oakland, 
Falkenberg, and Oakland (1996), no 
one assessment adequately assessed the 
construct of leadership in youth. The 
1 1 assessments examined did not meet 
psychometric standards, we re inappro- 
priate for the age of the population, or 
were not constructed under the current 
concepts of leadership. The 11 assess- 
ments included The Leadership Aility 
Evaluation (Cassel & Stancik, 1982), 
Leadership Skills Inventory (Karnes & 
Chauvin, 1985), Eby Gifted Behavior 
Index (Eby, 1989), Gifted and 
Talented Screening Form (Johnson, 
1979), Gifted Evaluation Scale 
(McGarney, 1987), Scales for Rating 
the Behavioral Gharacteristics of 
Superior Students (Renzulli, 1976), 
Leadership Appraisal Survey (Hall, 
1986), Styles of Leadership Survey 
(Hall & Williams, 1986), Leadership 
Opinion Questionnaire (Heishman, 
1989), Supervisory Behavior 
Description Questionnaire (Fleishman, 
1989), and Gampbell Leadership Index 
(Gampbell & Kraut, 1991). 

The existing leadership assessment 
instruments are largely teacher or self- 
report instruments. These instruments 
often fail to define a specific set of 
behaviors linked to leadership. 
Furthermore, none of the instruments 
specifically assess leadership in an 
authentic setting. These concerns with 
current leadership assessment instru- 
ments require a new light to be cast 


upon the assessment of leadership 
behaviors and traits. 

This study seeks to answer the fol- 
lowing questions: When students are 
assigned to groups where no leader is 
appointed or designated, can a process 
be created to identify the emerging 
leader? What observable behaviors sup- 
port the identification of an emergent 
leader in a problem-solving situation? 
Does a relationship exist between leader- 
ship self-report assessment instruments 
and authentic assessments through 
structured observations? 

Method 

Participants 

The Interdisciplinary Greative 
Problem Solving Gonference is an 
annual conference held at Baylor 
University for identified gifted and tal- 
ented students in grades 8-12. Students 
from across Texas spend 2 days working 
in groups and use the Greative Problem 
Solving process (Treffmger, Isaksen, & 
Dorval, 2000). All groups are given a 
common mess, form a problem state- 
ment, and develop a subsequent solu- 
tion. The groups then present their 
solutions using skits, banners, 
brochures, and PowerPoint presenta- 
tions to an audience of judges, teachers, 
and peers. 

In this study, participants included 
83 8th- through 12th-grade students 
from various middle schools and high 
schools in Texas. All participants were 
identified as gifted and talented by their 
school district. The group was com- 
posed of 32 male participants and 51 
female participants. Age ranged from 13 
to 18 years of age, with 2% (« = 2) 13 
year olds, 24% (« = 20) 14 year olds, 
33% [n = 27) 15 year olds, 25% (« = 
21) 16 year olds, 12% (« = 10) 17 >ear 
olds, and 3% (« = 3) 18 year olds. The 
83 participants were assigned to six 
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color-coded groups. Participants from 
the same school were separated to the 
extent possible and also were assigned 
by age and talent so that each group was 
diverse and contained students with tal- 
ents in each of the product areas. 
Twenty-one (25%) of the participants 
attended the ICPSC in at least one pre- 
vious year. This was the first conference 
for 51 (61%) of the participants, and 1 1 
(13%) did not respond to the question. 
An adult facilitator (2 males and 4 
females) and counselor (6 females) we re 
present to guide the students through 
the process. Three facilitators had previ- 
ous training in the area of gifted educa- 
tion and the process of facilitating 
Creative Problem Solving groups. Two 
had training only in gifted and talented 
education, and one facilitator was a fac- 
ulty member of Baylors School of 
Education with no previous experience 
with Creative Problem Solving or gifted 
and talented education. 

Instruments 

The participants completed two 
self-assessments of leadership at the 
beginning of the conference. The instru- 
ments we re an altered form of the 
Renzulli-Hartman Scales for Rating 
Behavioral Characteristics of Superior 
Students and an altered form of the 
Gifted and Talented Evaluation Scales 
(GATES; Gilliam, Carpenter, & 
Christensen, 1996). Each item on the 
instruments was altered from third per- 
son to first person, producing a self- 
report instead of a third-person report. 
Thus, the content was not altered, but 
the person of the pronouns and verbs 
was (see Student Self-Assessment, Part I 
and Part II in Appendices A and B). 

The Renzulli-ffartman Scale con- 
sists of 10 subscales, one of which specif- 
ically assesses leadership characteristics. 
Subjects respond to a 10-item four-point 
Likert scale, and the possible range of 


“The existing leadership 
assessment instruments 
are largely teacher or 
self-report instruments. 
These instruments often 
fail to define a specific 
set of behaviors linked to 
leadership. Furthermore, 
none of the instruments 
specifically assess 
leadership in an authentic 
setting. These concerns 
with current leadership 
assessment instruments 
rec^uire a new light to 
be cast upon the 
assessment of leadership 
behaviors and traits.” 

scores is 10 to 40. The stability coeffi- 
cient reported for this instrument is .77, 
with the interrater reliability coefficient 
being .67 (Oakland, Falkenberg, & 
Oakland, 1996). 

The GATES is a behavioral check- 
list used to identify people who are 
gifted and talented. There are five inde- 
pendent scales based on federal and state 
definitions of leadership totaling 50 
items. GATES reports a test-retest mea- 
sure from .42 to .97. The leadership 
subscale agreement has a test-retest mea- 
sure of .68 to .95. A Cronbach alpha was 
reported at .96 to .97 with SEM + 2.6. 
A correlation of .81 was reported for the 
Renzulli-Hartman (Gilliam, Garpenter, 
& Ghristensen, 1996). The jot down 
instrument consists of 12 behaviors. 
Each group participant receivai one 
tally mark from the observer for each 
instance a behavior was exhibited. 


The jot down instrument was devel- 
oped through focused interviews with 
experienced facilitators. They were asked 
to describe behaviors of students who 
are influential within the problem-solv- 
ing group. Responses were compiled and 
combined until 12 behaviors emerged 
that operationalized the definition of 
leadership. The 12 behaviors were resub- 
mitted to the facilitators for review. 
Revisions and clarifications were made, 
resulting in the final form. The facilita- 
tor, counselor, and students completed 
the jot down instrument, requiring that 
one student be chosen who best exem- 
plified each specific behavior. 

Procedure 

The students spent a total of 10 
hours together over a 2-day period 
applying the Gle at ive Problem Solving 
model. The six groups worked through 
a mess, identified what they perceived 
to be the overarching problem, and then 
created a solution to the problem. After 
the mess was introduced, group mem- 
bers volunteered to attend expert ses- 
sions to gather further information that 
pertained to the mess. Subgroups were 
also formed to create a banner, 
brtochure and skit expressing both the 
problem statement and the solution. A 
research assistant observer was assigned 
to each group to record on the jot down 
sheet the behaviors student participants 
exhibited. A video of each group’s inter- 
actions was also taken for verification of 
the research assistants’ observations. 
Near the end of the pioblem-solving 
process, student participants were asked 
to complete an observational form indi- 
cating which group member they 
thought most exhibited each of the 
behaviors included on the jot down 
sheet. Facilitators and counselors in 
each group also completed observa- 
tional forms containing the jot down 
behaviors. 
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Table 1 

Self-Report Assessment Results 



Identified Leaders 
(« = 13) 

Nonidentified Leaders 
(« = 70) 

Self-Report Assessment 

M SD 

M SD 

Renzulli-Hartman 

33.68' 2.78 

30.69 4.02 

CATES 

75.20 10.53 

68.73 9.86 

Note. * p < 0.05 


Results 

and Discussion 

This study examined the question of 
whether leaders can be identified 
through observations in a problem-solv- 
ing situation where students are assigned 
to groups where no leader is appointed 
or designated. In each of six groups, the 
facilitator and counselor, students, and 
research observers reached ageement 
regarding the leader. 

The question posed focused on 
whether a recognized leader will emerge 
in a group in which no leader is 
appointed or designated, and student 
participants’ perceptions \wre also 
examined to find agreement with the 
perceptions of the adult observers. 
Agreement between the student 
responses and the adult responses sug- 
gests that a recognized leader did 
emerge. This supports a consensual the- 
ory of leadership; though hard to define, 
people are able to agree on who is the 
leader of a group working on a problem- 
solving task. 

Within the problem-solving situa- 
tion, four specific leadership behaviors 
emerged as most prominent from the 12 
included on the jot down. The behav- 
iors most attributed to the emerging 
leaders were the following; (a) this stu- 
dent kept the group focused, (b) this 
student offered compromises that were 
accepted by the group, (c) the group lis- 
tened to this student and respected his 
or her opinion, and (d) the group fre- 
quently agreed with this student (see 
Appendix C). The hypothesis that 
emergent leaders also exhibit a broader 
range of behaviors (Guastello, 1995) is 
reinforred by these data. Each leader 
identified by his or her fellow group 
members, facilitator, counselor, and 
observer demonstrated a greater num- 
ber of behaviors from the jot down 
sheet in comparison to his peers. 

In addition, the relationship that 


exists between the leadership self- 
report assessment instrument and the 
authentic assessment through struc- 
tured observations using the jot down 
was examined. In three of the six 
groups, the top two leaders identified 
by the jot down scored higher than the 
other members of their group. 
Therefore, some relationship exists 
between the observational assessment 
using the jot down and the self-report 
(see Table 1). 

Limitations of this study need to be 
explored. Placement of the video cam- 
eras left much of the footage unusable, 
which prohibited verification of the 
observers’ results from this data point. In 
replication studies, the use of two 
observers per group is suggested in order 
to establish interrater reliability. Due to 
the situational nature of the study, fur- 
ther data should be collected on leader- 
ship roles taken by these students in 
their schools and communities to exam- 
ine relationships and validity of concepts 
of emergent leadership. 

Implications of this descriptive 
study suggest that, over arelatively short 
period of time, it is possible to identify 
the leader of a group by observing and 
recording predictable leader behaviors. 
In many cases, gifted and talented pro- 
grams do not identify and serve gifted 


leadership, and it is hypothesized that 
this omission is not due to a lack of 
interest, but rather to a lack of confi- 
dence in the ability to identify those 
gifted with leadership abilities. 
Demonstrating that it is possible to 
observe a specific set of behaviors dur- 
ing an authentic task opens new possi- 
bilities for leadership identification and 
service in the field of gifted education, 
©(g? 
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Name _ 
School 


Appendix A 

Student Self-Assessment, Part I 

Age 


Grade 


Male or Female (circle one) 


Fiave you participated in this problem solving conference before? Yes or No (circle one) 

For the following ten items, please circle the number that best corresponds to you and your behavior The numerical values are 
as follows: 

1 . This seldom or never applies to you. 

2. This occasionally applies to you. 

3. This most of the time applies to you. 

4. This almost always applies to you. 


1 . I can be counted on to do what I have promised, and I usually 
do it well. 

2. I am comfortable when asked to show my own work in class, 
and I am confident in my abilities. 

3. I am well-liked by my classmates at school. 


12 3 4 


12 3 4 


12 3 4 


4. My teacher and classmates would describe me as easy to get 
along with, and 1 tend to avoid arguments. 

5. I can express myself well, and 1 am usually well understood. 


12 3 4 


12 3 4 


6. 1 adapt easily to new situations, and 1 am not bothered 
when my normal routine is disturbed. 

7. I prefer to be around other people rather than alone. 


12 3 4 


12 3 4 


8. 1 prefer to be in charge of the activities in which 1 am involved. 


12 3 4 


9. I participate in most of the social activities at my school. 


12 3 4 


10. 1 excel in athletic activities and enjoy participating in sports. 

From Renzulli, J. S., Smith, L. H., White, A. J., Callahan, C. M., & Hartman, R. K., 1976. 


12 3 4 
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Appendix B 

Student Self-Assessment, Part II 

Using the 9-point scales next to each item, rate yourself relative to the item descriptors. Indicate your rating by circling 
the appropriate number. Think about yourself in this way: Example: Compared to other students of the same age, I work 
well in groups. 

Compared to other students of the same age, I .. . 


1 . Am a leader among my classmates. 

2. Am liked by my peers. 

3. Am persuasive in talking with others. 

4. Get along with others. 

5. Work well in groups. 

6. Influence the behavior of others. 

7. Work effectively with others. 

8. Am social and enjoy being around others. 

9. Find it easy to participate in group activities. 

10. Actively participate in group decision making. 

From Gilliam, J. E., Carpenter, B. O., & Christensen, J. R., 1996 


Appendix C 

Leadership Observation Inventory 


#1 This student kept the 
group focused. 

#2 This student offered 

compromises that were 
accepted by the group. 

#3 The group considered 
this student popular. 

#4 This student involved 
the whole group. 

#5 The group listened to 
this student and 
respected his/her opin- 
ion. 

#6 The group frequently 

agreed with this student. 

#7 This student encouraged 
others in the group to 
cooperate. 

#8 This student encouraged 

others. 

#9 This person understands 
creative problem solv- 
ing. 

#10 This student under- 
stands problem. 

#11 This student contributes 
new ideas. 

#12 This student organized 
the group. 


Below Average Above 

123 456 789 

123 456 789 

123 456 789 

123 456 789 

123 456 789 

123 456 789 

123 456 789 

123 456 789 

123 456 789 

123 456 789 
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